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ABSTRACT 

The Chicago Effective Schools Project (CESP) is a 
demonstration program, involving racially isolated schools (Black and 
Hispanic) , designed to provide equal educational opportunity and 
excellent school programs in schools that cannot be desegregated . 
This report describes the program as it was implemented in fiscal 
years 1982 and 1983. The program description includes a brief review 
of the effective schools literature; major evaluation variables; 
program design and implementation; and program implementation in. 
Hispanic and bilingual schools. Evaluation results summarized 
indicate (1) that the program was generally conducted as intended; 
(2) student achievement improved for most grade levels, and 20 of the 
CESP schools. moved upward. in_ the ranking of the Chicago elementary 
public schools; (3) most CESP students and their parents had positive 
attitudes toward the program, although a significant minority were 
ambivalent or negative toward certain of its aspects; (4) few 
students understood the Chicago Mastery Learning units; and (5) 
although there was some staff disagreement about the provision of 
bilingual services , bilingual students expressed positive attitudes 
about the program. Recommendations for program improvement are 
presented. (CJM) 
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PREFACE 



The Chicago Public School Student Desegregation Plan is the direct result 
of a Consent Decree entered into in 1980 by the United States Department of 
Justice and the Chicago Board of Education, It was that decree which 
established the major goals of equity and _ excellence as part of the 
desegregation program of the Chicago Public Schools. 

the two major components of the Student Desegregation Plan are student 
movement and the educational components. The plan for student movement is 
the means by which the maximum possible number of students wil 1 attend 
school in a desegregated setting. The educational components plan is 
designed with excellence arid equity of the instructional program as its 
main, goals. 

Contained in the plan for educational exponents is the provision for the 
establishment of a demonstration program involving racial ly isolated 
schools (Black and Hispanic). This project is currently entitled The 
Chicago Effective Schools Project (CESP). It is one of the means by which 
equity of educational opportunity and excel lence of the school program can 
be attained in schools that cannot be desegregated. 

If the CESP program isto become a model for the other schools in our 
system, an ongoi ng evaluation that examines, in detail , the development of 
the. prbjoet is a necessity. It is with this need in mind that the CESP 
evaluation was established. The Bureau of Eq'jal Educational Opportunity 
Evaluation (EEDE), for the past. two years* has conducted the planning and 
implementation phase of the evaluation program. 
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EXECUTIVE SUMMARY 



The purpose of the Equal Educational Opportunity evaluation is to aid 
the_Chicago Effect ive Schools Project (CESP) by providing meaningful 
evaluation information to obtain positive outcomes from the CESP program. 
The course upon which the school systom has embarked requires flexibility and 
versatility of program to meet the needs of the large segment of the school 
population which, due to the total composition of the city, must remain 
racially identifiable. Evaluation that provides insight into program, _ 
strengths. and weaknesses is imperative if the project is to be optimally 
successful . 

The CESP project is a demonstration program. If it is to become a model 
for other schools, it must be examined in detail to ascertain the most 
effective elements so that they can be disseminated to other schools in the 
system. The initial year of the evaluation focused on the determination of 
the nature of the environment in which the project was conducted. The ideas, 
attitudes and experiences of the administrators, school staffs, parents and 
students were also studied. The major purpose of the evaluation was to 
ascertain the degree to Which factors deemed essential to the creation of 
effective schools programs were present in the CESP schools. 

The major concern of the evaluation during the second year (FY 1983), 
was assessment of program progress by the project participants. The 
i nf ormation gathered from these assessments provided a basis for compari son 
with FY 1982 topics introduced during the initial evaluation. This 
facilitated ad di tional data comparisons. 

The evaluation model consisted of four parts: 

I. A survey of student opinions concerning their schools, educational 
aspirations and other related topics. 

II. A school visitation program which included classroom and student 
observations, student interviews and general observations of the 
schools. 

III. Distribution of questionnaires to principals, teachers^ and 
parents. 



IV. Interviews with district, school and central program unit 
adminstrators. 

Conclusions drawn from the data are offered for serious consideration to 
achieve the goal of optimal student progress. The conclusions and some of 
the most salient findings of the evaluation are as follows: 

• The CESP_program_i s_general ly conducted as intended and reflects a 
number of concepts found in the effective schools literature. 
Evidence indicates that a variety of approaches are included 
in the program designs of the individual schools. 

1 
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Program Implementation has improved, but there are still problems that 
need to be solved. The major problem appears to be communication. 
Remedies have been suggested by aTi persons concerned with the 
program. 

Principals are general ly positive concerning the progress of the GESP 
program. However, teachers, though somewhat positive, express 
reservations concerning a number of program areas. Teacher attitudes 
toward the achievement potential of the students tend to be less 
positive than the principals 1 attitudes. 

The principals who assessed their program's progress were general ly 
accurate in their assessment of their students 1 progress in academic 
achievement. The positive attitudes of the principals tend to be 
justified by the reported achievement of their students. 

Twenty of the CESP schoo]s_have moved upward in the . ranking of the 
Chicago elementary public schools and would not be included in the 
lowestachievlng schools were such a selection made today. This 
movement after the second program year is indicative of progress. 

Achievement of the_CESP students has improved for most grade 
levels. The most pronounced progress can be noted for the seventh and 
eighth grade students.,, Special efforts appear to have been expended 
in relation to the instructional program for these students^ 

Improvement in achievement.^ grade 
students has been less positive than for the other grade level In 
several subject areas there have been losses for one or more of these 
grade levels. This problem is a carryover from previous years. 
However* the second grade students are a recent addition to this 
group. 

A hunter of the GESP students have exhibited achievement that is near, 
equal to, and in a number of instances greater than national norms. 
There is an apparent heed to provide services for these students. 

GESP students like the Chicago Mastery Learning stories, exercises, 
etc. , and yet a bare majority felt they understood al ] of the 
material. Fewer mastery learning units were completed during the past 
year* 

CESP teachers commend, reprove and generally Interact with their 
students; however* students continue tofeel that it is not easy to 
talk with their teachers. The nature of the observed interaction was 
quite formal which could account in part for the students' feelings. 

Most CESP students and thei r_parents are positive towardt he program, 
but a significant minority of _ the. students _ana ambivalent or 
negative toward various aspects of the program. The increased noise 
level noted in some classes during observatipns_was evidently a 
problem to some students and could account, in part, for their 
attitudes. 



2 



19 



INTRODUCTION 



This report presents Chicago Effective Schools Project evaluation 
information gathered during the two-year period, Fiscal years 1982 and 1983. 
It contains both quantitative and qualitative information that can provide 
insight into program concerns. It is formative in intent. When the report 
information is considered along with the project administrators 1 experiences 
with the program, it could facilitate the decision-making process for the 
CESP project. 

The initial year of evaluation focused on the nature of the environment, 
in which the project was conducted. The ideas, attitudes, and experiences of 
the administrators, school staffs, parents, and students were also studied. 
The major purpose was to ascertain the degree to which factors deemed, 
essential to the creation of effective schools programs were present in the 
CESP schools. 

the major concern of the eval uation during the second year, FY 1983 was 
the project participants 1 assessments of program progress. The information 
gathered from these assessments provided a basis for comparison with data of 
the previous year. In addition, much of the data gathered during the second 
year concerned topics introduced during the initial eval uation. This 
facilitated additional data cbmparisibris. 

The organization of this report is essential ly the same as that of FY1982. 
Topics which were part of that report are also included in this document. They 
provide information as fol lows : Major Evaluation Vari ables presents CESP 
student standardized test result s*_student attitudes* attendance and mobility; 
and The Chicago Effective Schools Design di scusses the extent to which 
characteristics as delineated in the effective schools literature are apparent 
in the structure and operation of the CESP programs. 



The CESP Program and Its Implementation, provides an overview of the total 
CESP program. Its intent is to provide the beginnings of a working model of the 
program based on the actual experiences of those persons res ponsible for program 
organization and implementation. 

The Hispanic and Bilingual Schools jg-the E ^SP Project, a new topic, 
di scusses the bilingual program and the CESP program in the Hispanic schools. 
The resulting i nf ormation is an introduction to a consideration of the needs 
and concerns of the Hispanic and/or bilingual students. A more in-depth 
study will be undertaken during FY 1984. 

This report is presented in two volumes. This volume contains : 

• The Effective Schools Literature (A Brief Sketch) 

• Overvi ews of Program Component s 

• Discussion of Evaluation Results 

• Recommendations and Implications for Program Modification 
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The executive summary presents the conclusions and some of the more 
salient information pertaining to the CESP program. 



Volume II* the technical volume, includes detailed program outcomes, 
related statistical information, and the evaluition methodology. 
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THE EFFECTIVE SCHOOLS LITERATURE 
(A Brief Sketch) 



The concept of effective schools has been expounded by many theorists 
oyer the past ten years. Teams of researchers, including such pioneers in 
the field as Dr. Ronald R. Edmonds and Lawrence Lezotte, have analyzed 
empi rical ly as wel 1 as infe rent ia[ly wh at factors led to effective learning 
in schools. Much of the discussion centered around establi shing character- 
istics of an effective school; a general theory that coul d be appli ed to 
specific situations. The effective scKols theories attempted to put into 
scientific terms what is essentially intuitive, certain practices that can 
make a school nore "effective" than others. 

There are certain tenets throughout the li terature that are common among 
effective schools. One of the chief tenets isthe belief that the principal 
must exert strong leadership. In their book entitled Creating Effecti ve 
Schools , Brookover and associates found that the principal , or someone else 
who acts as the leader, must set clear and specific learning objectives for 
each grade level and each course otherwi se_they tend to go in different 
directions with no comprehensive focus. 1 Besides coordinating specific 
objectives among the various grade levels and courses, the principal must 
provide sufficient materials for the implementation of the program objec- 
tives. Another key factor mentioned throughput the literature on effective 
schools is the_ increased amount of student time on task required. In 
practically all Effective School Models, _a high amount of time on task is a 
substantial contributor to the success of the program. Students are to be 
treated with the highest expectations with regard to their learning 
potential . Brookover and associates felt that al 1 children should be 
expected to learn tWe same patterns of behavior and there should not be 
differentiation between those who are or are riot expected to learn. 

the Annual Desegregaton Review for 1982-83 listed most of these same 
factors mentioned throughout the literature on effective schools and 
embel li shed them with others. 2 The factors listed by the Annual Desegrega- 
tion Review as key to the devel opment of effective schools are: (ij strong 
principal leadership, (2) high time on task, (3) high expectations for 
learning, (4) parental and community involvement, (5) increased use of 
achievement test results, and (6) generally favorable school climate. The 
goal of effective schools, accordi ng to the review is to remedy "negative 
impact of racial isolation on minority student achievement. This was to be 
accomplished by improving instruction and achievement in the maximum feasible 
number of raci al ly identifiable schools by implementing an instructional 
program based upon the Effective Schools model 

Dr. Edmonds summarized the concept behind the effective schools. 3. He 
felt that al 1 children are educable. Pupil educabili ty derives from the 
nature or condition of the school rather than the family. Final ly, he 
theorized that al 1 staff must believe an J support these two concepts fully in 
order to achieve effectiveness. 

In their critique of-effectlvesehoolsliterature, Purkey arid Smith 
summarized the key variables as follows: (1) how schools and their di stricts 
make decisions, (2) how classrooms and schools can. be changed to increase 
time on task, (3) creating a school climate conduci ve to learning* arid (4) 
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district al lbwance_ of individual school dh-si te management Purkey and 
Smith were critical of hbW the early researchers derived their conclusions; 
however, they felt that the effective schools concept made_ good common sense 
and its basic factors are worthy of consideration^ They also ad\rised the 
exercise of caution in accepting any particular group of factors as the total 
cnteHa_fo^ developing effective school s^ Michael Cohen agreed with 
Dr. Edmonds^ theory that schools can and must reduce to a considerable extent 
the dependence of student performance on family background * 5 This_iiea is 
based upon his observation that many poor achieving students come from, 
impoverished families that may hot provide the sufficient environment for 
learning. Tommy Tomlison, in his analysis of effective schools * summ|rizes 
much of the conclusions drawn from the literature into two sentences. 6 
"Effective schools leave little to chance; they impose conditions which, 
produce learning. That, it appears is the discovery of effective schools 
research." 

Reference List 

^rookover, Wilbur et al . treating Effective School s . Holmes Beach: 
Learning Publications Inc. 1982. 

2 Annua1 Desegregation Review 1982-83 Part II : Recommend a tions On Educational 
Components. Chicago Public Schools. August 1983. ^ 

3 Edmonds, Ronald. "Search For Effective Schools: The Identification and 
Analysis of City Schools That Are instruct ional 1y Effective for Poor 
Chil dren". Harvard University. 

4 Purkey, Stewart and Smith, Marshall. "Effective Schools: A Review" The 
Elementary School Journal . 83 No. 4, 427-451. 

5 Cohen, Michael . "Effective Schools: _What the Research Says" 
Today's Education. April 1981, 6065-6365. 

6 Tomlison, Tommy. "Effective Schools: Mirror Or Mirage?" Today's 
Education. April 1981, 6065. 
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SUMMARY OF THE FISCAL YEAR ±982 CESP EVALUATION 



The firs*; evaluation of the Chicago Effective Schools Project (CESP), 
conducted at the end of the 1981-1^82 school year^was designed to answer 
three questions. 1) To what degree was the special program actually put_ 
into effect in the forty-five targeted schools? 2) To what degree did CESP 
improve the academic achievement of the students in the targeted schools? 
3) To what degree were the CESP schools emulating "effective schools" 
characteri sties? 



Trans J ating Policy into gin Operating Program 

The principals at the targeted schools conducted needs assessments for 
their schools, fol lowing Of f ice of Equal Educational Opportunity (SEES) 
guidel i nes* The pri nci pal s then designed strategi es ; for improvi ng the 
quality of their schools based on their needs assessments and consistent 
with professional literature in which the characteristics of "effective 
schools" were outlined. State Title 1 and OEEO funds were allocated to the 
principals to implement the strategies they developed. 

How did the principals want to spend the OEEO and state T|t1e 1 money? 
OEEO funds available to pay for additional school personnel were typical 1y 
requested to hire people who work di rectlywith children in classrooms. 

Fifty-one percent of the requests for additional personnel were for 

teachers; 25 percent were for teacher aides. The two most popular uses for 
state Titla 1 funds were equipment (i.e. * sci ence or musical instruments, 
projectors , tape records) — requested by 86 percent of the principals, and 
supplementary books (i.e., dictionaries, math, science, readi ng)— requested 
by 53 percent of principals. 

Did the principals get what they ordered? They did, but not entirely. 
Approximately 95 percent of the 131 new positions made available with OEEO 
funds had been fil led by the end of the 1982 school year. The materials, 

however, did not get into the schools with the same rate of success. 

Seventy-three percent of the requested supplementary books and 80 percent 
of the equipment were in the schools at the end of FY 1982. Approximately 
80 percent of the other types of requested materi als made it to the schools 
(e.g.* 100 percent of the Mastery Learning supplies were sent to the 
schools but only 64 percent of the supplementary materials). 

Achievement Results 

As expected the Chicago Effective Schools Project did not work 
mi racles. However, there were obvious signs that the program was having a 

positive effect on pupil achievement in the targeted schools. The CESP 

schools^ targeted especi al lybecause they had the achievement scores among 
the lowest of the city schools, began "catching up" to citywide results. 
We have two different kinds of evidence for improved achievement. 



First, CESP schools were slightly more effective at raising average 
grade-equivalent scores than were city schools on the whole. _ The average 
change in ITB5 in reading comprehension grade-equivalent scores from FY 
1981 to FY 1982 was +.23 in CESP schools. The citywide change was +.10. 
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Second, students in CESP schools made considerably more educational 
progress during the 1981-82 school year than students in thbse_schbols had 
in previous years. At the end of 1982, students in CESP schools had gained 
an average of 8.1 months in reading comprehension. This was not as much 
growth as we want for every child in the Chicago Public Schools (alO-rporith 
gain for a 10-month school year). Neither was it as much as the city wide 
average of a nine-month gain in 1982. But, it shows enormous progress 
indeed from the 6.7-month average gain that students in EESP schools showed 
just one year earlier. 

Attendance and Mobility 

In FY 1982 attendance in elementary schools was 92.1 percent city wide. 
Only thirty-one percent of CESP schools achieved or exceeded this level of 
attendance. Very few principals (2 of 36) referred to attendance as an 
area for increased emphasis that year. Me can only hope that the 
principals 1 reported efforts to increase parental involvement in_school__ 
programs (21 of 36 principals) and to improve building security (16 of 36 
principals) indi rectly had a positive effect on attendance. More than 20 
percent of the students in the evaluation sample were new in 1982 and 
approximately 55 percent were enrolled for less than a full year. 



Emulating "Fffpr.tj ye Schools" Characteristics 

To what degree were principals behaving in ways that "effective 
schools" literature suggest are important? To what degree were CESP 
schools emulating "effective schools" characteristics? If the forty-five 
schools targeted for the project had_ characteristics very similar to those 
found in studies of "effective schools" then we would have known that 
either the wrong schools had been chosen for the project or else "effective 
schools" characteristics are meaningless. Therefore, when we looked for 
"effective schools" characteristics, we were gathering baseline data rather 
than eval uating. 

A few of the findings that were most instructive for us: 

When we i ntervi ewed pri nci pal s in 1982 only 25 percent (ni ne of 36) 
spoke of having a role as instructional leader in their school , and only 
six (17 percent) saw that as their primary role. There was considerable 
room for intervention in this area. 

Nearly 60 percent of the principals (21 of 36) reported trying to 
build parent and community involvement. They were using a wide variety of 
means to do this, but were troubled, nonetheless, with_the_ limited success 
they were having. Similarly, 63 percent of the 93 teachers interviewed did 

not feel that they were interacting effectively with parents. It is 

especially troubling that principals and teachers were aware of a problem 
and apparently trying to do something about it, yet felt so ineffective. 

Final ly almost half of the 93 teachers who were interviewed felt that 
they were not being given adequate inservice education. The same percent 
did not think there was effective pri nci pal -teacher communication in their 
schools. Again, there was room for improvement in those areas. 
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MAJOR EVALUATION VARIABLES 



ACHIEVEMENT RESULTS 



Optimal academic achievement for all students is the ultimate goal of 
an effective school. The CESP schools placed major emphasis on this 
objective. The results of the Iowa Tests of Basic Skills (ITBS) — the means 
by which achievement of Chicago Public Schools students is annually 
measured, will be examined to determine the progress of the CESP schools 
toward their objectives 

Table 1, below, presents the May 1S82 and 1983 results. It compares 
the median scores of each grade for the 45 CESP schools to the city wide 
results. Both the CESP and the city wide results improved significantly. In 
six of the seven grades reported, the CESP schools' medians increased by one 
to three months. At grade two there was a decli ne. City wide, four of the 
seven grades improved by one month; one grade did not change, and two 
decli ried. 

TABLE 1 

ACHIEVEMENT OF CESP AND ALL SCHOOLS CITY WIDE COMPARED 



ITBS Reading Comprehension Subtest 
(in grade-equivalent scores) 

CESP City wide 



Grade 


May 19 8? t 


May 1983 


May 1982t 


Mas^l93a 


2 


2.4 


2.2 


2.6 


2.5 


3 


3.0 


3.1 


3.4 


3.5 


4 


3.6 


3.7 


4.1 


4.1 


5 


4.4 


4.6 


5.2 


5.1 


6 


5.3 


5.4 


6.0 


6.1 


7 


6.2 


6.4 


7.1 


7.2 


8 


7.1 


7.4 


8.1 


8.2 


tThe May 


1982 scores have 


been converted to 


the new norms used 


for the May 



1983 scores. 



For both FY 1982 and FY 1983 the median scores for CESP students were 
lower than those for the city's public schools as a whole. However, their 
vocabulary, and reading comprehension medians exhibited a greater degree of 
improvement than the comparable citywide scores. 

Figure 1, on the following page indicates the changes in vocabulary and 
reading comprehension medians from 1982 to 1983 for both CESP and Citywide 
students. 
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FIGURE 1; Changes in Vocabulary arid Reading Ebmprehensfoh Medians For (BP and Cltywide Students 
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The mathematics concepts medians for CESP students also exhibited a 
greater degree of improvement than the comparable citywide scores. However, 
results were less positive in mathematics problem solving where di stance 
between citywide and CESP scores was about the same as in FY 1982. 

The change in Mathematics Concepts and Problem Solving medians for both 
groups are shown in Figure 2 on page 14. 

The seventh and eighth grade CESP median scores exhibited positive change 
in all four subject areas. However* their largest positive change was in 
mathematics problem solving arid their least positive change was in reading 
comprehension. 

Consider]* ng.the status of the 45 CESP schools as compared to their 
positions in 1981 in a ranki ng of regular elementary, middle schools, and upper 
grade centers, it is notable that twenty-nine schools have progressed beyond 
their positions in the original ranking. Twenty have advanced to positions 
that remove them entirely from the lowest achieving schools. Nine CESP schools 
have ad vanced to positions beyond the 100 lowest achieving schools. 



STUDENT ATTITUDES: A COMMENTARY PERTAINING TO THE CESP PROGRAM 



CESP students In thirds fifth arid seventh grade completed attitude surveys 
in 1982 and 1983. Fourth grade students were also surveyed in 1983. Approxi- 
mately 1000 students at each grade level responded both years. School climate, 
teacher and principal expectations for student devel opment , and student 
perceptions of their parents' attitude toward school are one set of indicators 
of "effective schools" characteri sties • These were the major constructs bri 
which the student survey was based. 

The students 1 attitudes remained relatively constant across surveys. 
Nearly al 1 students held positive attitudes about their school , their teachers 
and their parents. _ However, they were less positive in other areas. Slightly 
more than half commented favorably on the attitudes and behavior of other 
students at their schooU tess than half of the seventh grade students 
approved of their school 's ap pearance. In addition, just over half of all the 
CESP student respondents noted that their teachers were easy to talk with and 
liked students. 



ERLC 



13 21 




23 



ATTENDANCE AND MOBILITY: FACTORS IN CESP STUDENT PROGRESS 

School attendance is vital in the implementation of programs^ aimed at 
improving student achievement. It is commonly accepted that a relationship 
exists between what a student learns and how much of the class he or she 
attends. In order to assess student attendance and related factors^ 
systemwide attendance figures were analyzed along with extensive surveys of 
the 45 CESP schools* 

The percentage of CESP schools equaling or exceeding 91 percent 
attendance as reported in 1982 increased during FY 1983. Also, there was an 
increase in the proportion of schools equaling or exceeding the 1982 cl tywide 
attendance rate of 92.1 percent; however, fewer equaled or surpassed the FY 
1983 citywide attendance percentage of 93 percent. Compared to FY 1982s a 
slightly largerpercent of the CESP students were absent 18 or no re times 
during the FY 1983 school year. There was* however, a decrease in the number 
of new students enrolled in the classes. This may indicate increased stabi- 
lity of the student membership^ 

The membership of the CESP classes included a few permissive transfers 
and a larger number of Options for Knowldege students. Close to a third of 
the students in che evaluation sample were ECIA Cnapter 1 students. Also in 
the CESP classes were students enrolled in bilingual programs. 
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THE CHICAGO EFFECTIVE SCHOOLS DESIGN 



EXPECTATIONS FOR LEARNING 

Effective schools faculties, according to the research literature^ tend 
to consist of staff who have high expectations for their students. During 
the FY 1982 arid FY 1983 CESP evaluations, questions pertaining to expectation 
levels were asfeed of principals. arid teachers^. In addition^ for the FY 1983 
evaluation, information pertaining to parental expectations for their 
children was obtained. 

For. both fiscal years^ evaluation results showed that most of the CESP 
principals who discussed expectations were positive regarding their 
expectations for student progress^ 9ri the other hand, a smaller proportion 
of teachers were positive iritheir expectations of studerits_iri_FY_1982_ and an 
even smaller proportion displayed positive expectations in FY 1983. Also, it 
should be rioted that in FY 1983, a majority of principals and teachers who 
responded to the evaluation, felt that "the large number of students needi ng 
speci al help seriously detracts from a program for academic excel lence." 

Parents whose expectations were surveyed during the FY 1983 evaluation, 
displayed overal 1 positive expectancies for their children's progress. 



Effective school research literature iridic priricipals with 

strong leadership gualities tend to head effective schools^ During the FY 
1982 evaluation, principals discussed the ways in which they gave direction 
to their faculty ' members i This year, FY 1983^ both priridpa^s and teachers 
were asked to rate administrator/teacher communications in their school ~s; 
Communication between principals and parents as well as between principals 
and students was^a"[so ratedi In addition, the instructional emphasis that 
principals incorporated i nto thei r program goal s was extract edi Exami nation 
of such factors as communication jev^s, instructional ^phasis, and ability 
to direct faculty could he^p to determine to what degree strong leadership 
qualities were present among the CESP principals^ 

Results of the evaluation^ for the two fiscal years ^ showed^ that CESP 
principals felt that they worked closely with individual teachers and used a 
variety of ways to help jthenu Both principals and teachers felt that 
administrator/teacher ccxnmunicatiori was positive; although^ teacher opinions 
were less positive than the principalis. Positive ratings for administrator/ 
parent and administrator/student communications were offered by both 
principals and teachers i It was, alscr, found that principals tended to 
emphasize instructional rather than administrative program goal s. jn 
addition, teachers and parents indicated that principals were interested in 
all the students; and that their schools 1 organizational structure promoted 
orderly learning. 
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PARENT AND COMMUNITY INVOLVEMENT 

Parent and community involvement is of major concern in the .establishment 
of the Chicago Effective Schools model;. Questionnaires were distributed to 
the parents of students who were interviewed. Their responses as well as 
related responses from the CESP principals and teachers are presented here* 

In both FY 1932 and FY 1983 parents who responded to the evaluation were 
positive toward the school and the school staffs. They responded rore 
positively_in_FY 1983 than in the previous year. Principals were very 
positive concerning the level^ of parent involvement * Teachers were also 
positive, but somewhat less positive than the principals^ Open house, an 
annual_school_activity^ and school -community representatives (SCR) sponsored 
activates were deemed the best motivators for encouraging parents 1 involvement 
in school programs. There was some evidence that parent volunteers were 
active in at least some of the CESP schools. One principal noted that a more 
positive school climate was achieved by making parent volunteers feel that 
they were an integral part of the school program. 

EVALUATION UTILIZATION POTENTIAL 

A characteristic of effective schools which states that effective schools 

personnel use student achievement test results as a means of evaluating 

student progress, was the basis_for_a series^of questions asked during-the FY 
1982 principal interviews. Although principals involved in the FT 1983 
evaluation were not asked the questions used in the FY 1982 interviews , they 
completed questionnaires, on_which_ ccmments were made pertaining to the 
effective schools characterteristic governing use of achievement data. For 
both fiscal years, teachers Involved in the evaluation responded to a 
questionnaire which askedfor. their opinions on achievement, tests and how they 
used the results of such tests. 

A majority of the responding CESP principals for FY 1982 used achievement 
test results to evaluate student progress. Two princi pals in the FY 1983 
eval uation commented on such factors that lead to their schools 1 successful 
achievement results. One of these two principals, also, stated a factor which 
impeded the success of part of his program; the need for expediting evaluative 
stuffings concerning placement of students in special education classes. 

Eval uation results, for both fiscal years* showed that in planning and 
devel oping their teaching strategies^ most CESP teachers used achievement test 
results only some of the time. A smaller number of teachers, however, 
emphasized use of achievement test results much of the time. 



THE STUDENTS AND THEIR CLASSROOM EXPERIENCES 

Evaluators visited the CESP classrooms in both 1982 and 1983. Third, 
fifth, and seventh grade classrooms were visited in FY 1982. Some classes 
were visited three times. A total of 202 class sessions were_ observed. One 
thousand sixty-nine individual students dbservationswere made. During FY 
1983, classroom visits were made to third, fourth, fifth, and seventh grade 
classrooms. One thousand three hundred and fifty-soven students were 
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observed^ A majority of the elassrbdms were visited twice, A total of 274 
class sessions were observed. 

The evaluation results for 1982 and 1983 revealed that most of the CESP 
students liked their school and classroom. Those students who did not like 
their classroom wanted to be in another school or at home. This year, there 
was a decrease in the percentage of individual students observed attending 
to task. There also was a decrease in the percentage of classes observed 
quietly attending to task. 

Mathematics was the subject observed being taught most in the CESP 
schools. Other subjects frequently observed were mastery learning, 
spe"Ning^ social studies and basal reading. Most of the students were 
attending to task when observed. This was true for more of the students in 
CMLR than in the other classes. 

The teachers in FY 1983, as well as last year, favored whole-class 

instruction over individual instruction and more of them commended student 
behavior than in the previous yaar. There was also an increase in those 
reproving student behavior. 

This year and last year, the CESP students assessed their work In 

mastery learning, basal reading, and mathematics. Their personal assess- 
ment s_ revealed that for both years, more third grade students than students 
in other grades, felt they understood al 1 their work in those three subject 
areas. There was, however, an increase in the nuntoer of seventh grade 
students who stated they understood all of their work in the subjects 
noted. 

This year the seventh grade CESP students were asked if they had 

learned what they needed to know. The majority answered yes to this 
question and attributed this to the efforts of their teachers. 

GENERAL SCHOOL CLIMATE 



Evalua tors, while visiting the CESP schools, made observations on 

several diverse topics. These included: school spirit, physical condition 
of school buildings, school atmosphere and school goals. 

In FY 1983 more of the components thought to be important to the 
implementation of an effective school were present and in operation in the 
CESP schools. Indicators of positive school spirit and school goal s were 
observed. The majority of the school . buil di ngs were rated in good to 
excel lent condition, and fewer were rated in poor or unsatisfactory 
condition. The atmosphere in most schools was generally positive. Stude nts 
and teachers usual ly interacted in a relaxed and orderly manner. However, 
in some instances* though some order was present* behavior was mostly 
unrestrained. 
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THE CESP PROGRAM AND ITS IMPLEMENTATION 



THE PROGRAM STRUCTURE 

The original intent of the CESP program was to improve educational 
standarcs_in a set of racially identifiable schools with low achievement 

scores* To achieve this goal , a needs assessment_for each school was 

developed by the principals, staff and community representatives fol lowing 
OEEO guidelines, Funds then were to be channeled into the specific areas^ 
delineated in the heeds assessments. Program content came in various forms 
like hiring new staff* reducing class size* and addi tional resources. When 
assessing the progress of their programs* principals were generally satisfied 
that improvement was noted in the areas of student achievement, attendance, 
discipline* parent participation and school security. Also, principals cited 
increased funding and additional staff as key success factors in their 
program implementation. Conversely,. the_reasbris most frequently cited for 
failure to implement programs were also funding and staff. In the future, 
CESP principals hope to have more materi als, planning time, parental 
involvement, funding, positions and improved implementation. The program 
administration planned to initiate nK>re extended-day activities and gifted 
programs for CESP schools in the future. 



IMPLEMENTATION 

An important corollary to any discussion of program goals would have to 
be the effectiveness of their implementation. In the year sincethe FY 1982 
CESP report, varying degrees of implementation were experienced in the 
schools. In order toassess the effectiveness of program goal implementa- 
tion, a new questionnaire was developed and sent to CESP principals. 
Several questions on the new form were similar to those of the previous 
year. This was done for the sake of comparisons Other questions probed 
into what changes in implementation could be perceived by the principals 
oyer_the past year. In addi tlon^ the results of the teacher opinion survey, 
which assessed teachers^ attitudes according to their effect upon 
implementation, were included. 

An analysis of_the data Indicated a general improvement in implemen- 
tation from FY 1982 to FY 1983. A large number of principals had no major 
problems in fil 11 ng thelrrequests for new positions .They also were able to 
implement programs and receive materials on time. Teacher mo rale and 
communication with school administrators was considered, for the most part, 
satisfactory. Despite these overall positive comments, many principals st 11 1 
found factors impeding implementation such as: uncertainty over program 
continuation, lack of funds, and lack of time for planning and 
implementation. 
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THE HISPANIC AND BILINGUAL SCH00LS IN THE CESP REP9RT 



THE BILINGUAL PHQSRAMS 

The Supreme Court upheld in Lau v. Michlosl (1974) that school districts 
are compelled under Title VI of the Civil Rights Act of 1964 to provide 
children who speak little or no English, with special language programs which 
will offer them an equal opportunity to an education. Bilingual education is 
an instructional approach using the native language for learning subjects 
until language skills have been developed sufficiently for participation in 
an al 1-Engli sh-speaking classroom^ This i nstruetibrial program aims at_ 
pi ovidi ng limi ted-Engli sh-prof icient children with an equal educational 
opportunity. 

Becau-se of the Chicago Public School *s committment to improve bilingual 
programs in theracial ly isolated schools, 2 it is imperative that the 
evaluation of the CES^ Project examine the bilingual programs which exist in 
the ten Hispanic CESP schools. In May 1983, questionnaires were distributed 
to the principals and a sample of teachers in the Hispanic CESP schools. 
These instruments collected data on the implementation aspects and percep- 
tions of various participants toward the bilingual program. The results of 
the survey served as an introduction to the needs and concerns of the 
bilingual program participants. 

A lack of agreement was noted between the principals and teachers on 
some of the issues concerning the bilingual program. Qne such issue related 
to the goals of the bilingual program. While most of the principals partici- 
pating in the survey agreed that the goals of the program were clearly 
defined and that the goals were developed cooperatively, less than half of 
the teachers were in the same agreement. Disagreement was aho reported by 
both groups on the provision of bilingual services to all limited-English- 
proficient (LEP) students. All of the principals were in agreement that al 1 
LEP students were receiving services while less than half of the teachers 
were in agreement. 

Discrepancies also were reported on the academic expectations for the 
bilingual program students. Whereas aUthe principals participating in the 
survey reported a high degree of academic expectations, only half of the 
teachers rated the principals as having high academic expectations for 
bilingual program students. Most principals also reported that the program 
promoted positive parent involvement, very few teachers had the same 
sentiments. 

There was, however, noticeable areas where the principals and teachers 
were in agreement. Un the issue of support for the bilingual program, not 
only were most of the teachers in agreementthat the principals supported the 
program, but al 1 of the principals were in strong agreement that the teachers 
were supportive of the program. The high correspondence between the ratings 
of *he principals and the teachers concerning their support of the bilingual 
program indicates that there is an interest from both groups in promoting a 
positive attitude toward the bilingual program. 



1 414 U.S. 563 (1974). ... 

2 Student Desegregation Plan for the Chicago Public Scho ols: Recommendat ions 
on Educational Components pg. b'/I 
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FACTORS fflNHFRN ING SCHOOL CLIMATE 



In this year's evaluation i* the CESP Hispanic school data were examined 
separately in order to get a more specific viewof their ideas, attitudes and 
experiences in the schools. The school observations were conducted in the 
same manner as in the rest of the CESP schools. Evaluators observed indi- 
cators of school spirit, condition of school buildings, school atmosphere 
and school goal s. There were four CESP Hispanic schools visited, and twenty- 
one observations made. During the school observations, evaluators noted 
indicators of positive school spirit. School building's condition, school 
atmosphere and school goals were observed to be high or positi/e; 



HISPANIC STUDENTS AND THEIR CLASSROOM EXPERIENCE 

The evaluation results for FY 1983 assessment of CESP Hispanic student 
and their classroom experience revealed that the majority of students and 
classes attended to task. It was noted that more classes attended to task 
noisily, than quietly. 

The subjects most vreq uently observed being taught were mathematics, 
social studies, and grammar. 

The majority of CESP Hispanic classes and individual students were^ 
obse rved receiving instruction as whole classes. This was the teachers 1 
usual instructional method. 

To stimulate learning, teachers in close to half the classes requested 
pupil response and responded to raised hands. However, they rarely commended 
or reproved Hispanic student behavior or performance. 

The Hispanic students, like their counterparts in the CESP schools, 
liked their school and classroom. However, when asked to indicate whether 
they preferred to be in their classes or in other locations, twenty percent 
of the Hispanic students preferred to be at home. They cited noisy 
classrooms - 9 quiet homes, television viewing and other reasons for their 
preference. 

The CESP Hispanic students' personal assessment of their work in mastery 
learning, basal reading, and mathematics revealed that more of the students 
understood basal reading than mastery learning or mathematics. 

Most of the Hispanic students felt_that they needed assistance from 

their teacher to understand schoolwork and asked their teacher when they 

needed help. Some stated they hardly ever asked for help; however, the 
majority felt their teachers helped them a lot. 

Most of the Hispanic students stated they were good students and they 
made good grades. A small percentage said they made fair grades and even a 
smal ler number stated they were lair students. 

This year the seventh grade CESP Hispanic students, like their counter- 
parts, were asked if they had learned what they needed to know. The majority 
of the Hispanic students answered yes and attributed this to the efforts of 
their teachers. 
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DISCUSSION OF EVALUATION RESULTS 



The evaluation outcomes of the CESP program will be discussed in 
relation to the following topics: 

- Current Program Operation as Compared to Original Intent 

- Progress Toward Program Goals 

- The Bilingual and Hispanic CESP Schools 

- The Chicago Mastery Learning Program 

- The CESP Higher Achieving Students 

Where appropriate* academic achievement and the effective schools design will 
be discussed in connection with each topic. 

CURRENT PROGRAM OPERATION AS COMPARED TO ORIGINAL INTENT 

Is the CESP program operating as originally intended? The following 
points may provide answers tothis question. Review of the research 
literature on effective schools indicates that Chicago has elected to adopt 
two concepts as a direct outgrowth of the literature: All children can learn 
and all students should be evaluated with the same high expectations 

regardless of race or past performance. Also* Chicago has chosen to 

exemplify strong principal leadership* staff development, parent involvement 
and increased time bn_the_ learrii rig task as those concepts most salient to 
school improvement. The Chicago Mastery Learning program* the city wide 
school discipline code arid the school promotional policy also reflect 
elements advocated by the effective schools literature. 

The CESP schools were not compelled to f o 1 1 ow any one proponent of the 
effective schools concept. Rather, they were exposed to several of the 
leading theorists and were expected to select and adapt the elements of the 
various doctrines to the needs of thei r iridi vidual schools. At the same time 
they we re made aware of those areas to be emphasized in the Equal Educational 
Opportunity program. Proposals, that we re subseq uently developed, reflected 
these guidelines* To the degreethat proposals continue to reflect some 
portions of the concepts of the li terature arid include. the elements deemed 
important by the school system it can be stated that planned activities wil 1 
be in line with the origi nal i ntent. The operational ization of the plans 
varied. Many factors impe nded on program operational procedures. Program 
modification was an ongoing process arid accordi ng to the central program 
administrative staff it continues to be a major program element. Program 
administrative staff planning includes . attempts to remedy problems. The 
degree that these procedures are effective wil 1 determi rie the degree to which 
program operation will be iri line with the original intent. 



l^TBBARB- PROGRAM GOALS 

To what degree are the CESP schools progressing toward goal achievement? 
The CESP schools, when original ly selected* were among the lowest achieving 
schools in the Chicago Public School system. They are now in positions among 
378 of the schools. At the outset* it was possible that if the school system 
as a whole pr ogres sed iri achievement* the CESP schools would hold their 
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original positions and thereby continue to be the lowest achieving sehodls in 
the system. To _date t thisisngt the case; Twenty schools have mbved but 
and beyond their original places in the ranking of elementary sehbols^_ Some 
schools still within the group of lowest schools have moved upward ^ while 
some schools have moved downward. Nevertheless, the net result at this point 
is progress. 

It is important to consider the fact that CESP exhibited a higher degree 
of _positiye_change inachieyement mecji an scores than did citywide. If CESP 
positive change in medians continuously occurs at a faster rate than such 
changes citywide, CESP student achievenent could eventual 1y equa} citywide 
elementary, school _medi ans. Som expected due to 

measurement errors and natural phenomena that tend to contribute to 
variation of movement. Improvement thus far indicates that CESP schools 1 
progress goes beyond what would be expected if there were no program of 
intervention. 

_ Princi pal s_were positive, toward thai r schools, staff s_and the progress 
of their students. Their attitudes were supported by the achievement results 
intheir schools. Progress in achievement was noted in most subject areas at 
all grade levels by a group of principals who were satisfied with their 

sehodls 1 progress and at all but one grade level in schools of highly 

satisfied principals. Approximately equal numbers of positive and negative 
changes in achievement were noted for the schools in which the principals 
were not satisfied, but felt that achievement was improving. 

If it is assumed that the potential for optimal achievement on program 
goals is enhanced to the degree that those directly involved in the program 
are. positive in their attitudes toward its objectives, then teacher morale 
ebuld be considered an important element. CESP teacher morale_appeared to be 

generally good and was enhanced by satisfactory teacher/administrator 

communication. However, twenty-one percent of the teachers who responded to 
the evaluation felt that communication was not satisfactory. An additional 
eleven percent were not satisfied, but felt that communication was 
improvi ng. 

There was more communication between the teachers and students. This 

could haye contributed to improved achievement. Also, teachers mo re 

frequently commended and reproved students concerning their performance and 
behavior than in tile previdus^year . Students expect to be commended and 
reproved by their teachers. They view this ?s evidence of their teachers' 
concern for them* However* interviews with CESP students indicated that 
though they had positive attitudes toward their teachers, the students did 
not find it easy to talk with them. . There could be some connection between 
this difficulty and the teachers 1 attitudes concerning the students' 
motivation to learn* The students believe their teachers are motivated to 
teach but the question is, do the teachers believe the children want to 
learn. Implicit in high teacher expectations is the belief in the students' 
ability arid motivation^ Without a positive attitude toward the learner, high 
expectations do not exist* 



26 

33 

ERLC 



It is notable that there was a disparity between the students 1 
perceptions of themselves as gob J. students arid their assessrrierit of their 
school work which they admit was less than adequate; There could be many 
reasons for this disparity* however* _the most detrimental aspect of its 
existence is the possible negative effect that it could have on achievement; 
This disparity did not exist among ths Hispanic students as an individual, 
group. Further study is needed to determine why CESP students see themselves 
as good students arid yet admit their performance is less than adequate. 

Staff development programs were generally well received, but a 
relatively small group of teachers participated in the programs. However; 
some teachers did participate in teacher education classes on their own 
i ni tiati ve. 

Parent involvement seems to be increasing though somewhat slowly. _ 
Parent participation in school activities may be increasing more rapidly than 
actual involvement of parents in the learning process of their children. At 
least one principal raised the questibri as towhether parent involvement or 
parent support of the educational system should be a goal of the program. 
This question has been rioted since the inceptibri of other educational 
programs, specifically ESEA Title I (now ECIA Chapter i). Nevertheless, 
there are programs that have demonstrated effectiveness that has been at 
least pa rti ally attributed to a high degree of actual parent involvement. 
Therefore, the consideration of parent involvement as a viable contribution 
to improved student learning should not be discarded. 

The presence and awareness of a school mission is one of the correlates 
espoused in the effective schools literature. If the existence and awareness 
of a mission by the students and school personnel could have a real influ- 
ence; then perhaps we could state that improved CESP achievement was 
partially due to the presence of school spirit or mission^ This is yet to be 
proven; but more evidence of positive^ school spirit was noted during the 1983 
school year in the CESP schools. Certainly no harm was evidenced by its 
presence; 



THE BILINGUAL ^ANEL -HISPANIC CESP SEHflQLS 

Ten predominantly Hispanic schools are a part of the CESP project. The 
data collected from these schools were reported as part of the total evalua- 
tion sample. However, it was felt that all persons concerned with the 
educational program for the Chi Public Schools could benefit from 
detailed information concerning the Hispanic and Bili ngual program students. 
Thus^ speci al sect ion was added to the ma in body of this report to hicjhl ight 
important factors related to their education. Certain outcomes are notable. 
First, the disparity between the principals^ and teachers^ attitudes related 
to the Bilingual program and secondly the lack of di span* ty between the 

students concepts of themselves as good students and their positive 

assessment of their performance as opposed to such assessments provided by 
other minority students. 
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CHICAGO MASTERY LEARNING PROGRAM 



Though generally well liked the CESF^ student^ 

indicated that mastery learning units were not predominantly understood; 

Neither the CESP population* as a whole nor the Hispanic students, as a group 
stated that they understood all of their. work jnChicago MasteryLearn 
Program (CML). This may account for the fact that fewer CML units were 
completed this year. However, there could be other reasons for this outcome. 

Conclusions should not be hasty. The most improved standardized test 
scores were noted for CESP seventh and eighth graders. This also was the 
group which completed more CML units compared to city wide seventh and eighth 
graders. When these facts a~e considered - 9 it would not seem reasonable to 
discount CML as a viable program of instruction. 



THE CESP HIGHER ACHIEVING STUDENTS 

Are we meeting the needs of all of the students in the CESP population? 
This is the question that should be addressed by school and central office 
staff concerned with the CESP program. Some students in the various grade 
levels have compared favorably to the national norms in reading, vocabulary 
and mathematics. It has been suggested that programs for gifted students be 
placed in the CESP schools. Central administrative staff have noted this as 
an impo rtant consideration. It is indeed a suggestion worthy of attention. 
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RECOMMENDATIONS AND IMPLICATIONS FOR PROGRAM MODIFICATION 



It can be stated that the CESP schools are progressing toward achieving 
their program goals. The task they have undertaken has never been considered 
a minor brie; it is* therefore* understandable that a total achievement of 
program goals has riot yet occurred. What is heartening is the degree of 
positive change that has occurred in a two-year period fraught with numerous 
problems* many of which are riot under the direct control of the school 
system. 

There are many implications for program modification within the data in 
this report. First, every effort should be expended to offset the trend of 
low_achievemerit in the middle grades.. Though this is a systemwide problem, 
CESP as a demonstration program, can lead the way in reversing this trend by 
providing insight into the problem. Caution shoul d be exerci sed that the 
upper grade instructional program continue to receive emphasis to prevent the 
1 oss of gains al ready made. Speci al attention is also needed for the second 
grade students whose scores prior to FY 1983 did not appear to be a problem 
area. 

Second, even more emphasis should be placed on the development of 
increased positive instructional staff attitudes toward the school, its 
program, and the students. Every effo rt should be made to bridge the 
communication gap that appears to exist between some teachers arid their 
students and to some degree, the teachers and their princi pals. 

Though complete individualization of instruction has been shown to have 
a number of serious drawbacks, near or complete abandonment of this approach 
cotMd also have a negative effect on student achievement. It is apparent 
from the responses of the principals that a number of them have cabined two 
approaches with considerable success^ Tutoring and smal 1 -group instruction 
appear to be major approaches in the CESP schools, while teaching the class 
as a whole group is the general instructional approach • However, providing a 
complete arid balanced instructional program is al so of extreme importance if 
the goal of providing quality education for all students is to be attained. 
A)} subject areas are important, and a complete and balanced curriculum 
should be maintained. 

At the same time that a Balanced curriculum is ad vocated, consideration 
should be given to enriching the basic program. Not just success, but 
optimal success is desired for the CESP project^ The needs of a*N the 
students should be met. Some program enrichment is desirable for all of the 
students. In addition, the students with unique abilities arid special 

interests should be encouraged to develop thenu The provision of a varied 

and enriched program could foster such developments Again this is taking a 
step beyond basic success toward optimal success. 

There, should, perhaps, be aneven closer examination of the Chicago 
Mastery Learning program and its effectiveness. Caution should be exercised, 
however to avoid drawing hasty conclusions in tfns regards Though the 
students apparently are not absorbing the program content, to a high degree, 
che reasons for this could be varied. Some of the questions for which 
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answers could be sought are^ hew often were mastery learning, lessons taught 
during the past year? To what degree did teaehers vary the lesson 
presentation in order to facilitate initial understanding of the lesson on 
the part of the students? Were all the steps in the lesson presentation 
followed? Is the completion of a certain number of mastery learning units 
the real determinant of achievement in the CML program? The mastery learning 
program is used in conjunction with the basal^ reading program. It is possible 
that_used in this manner, completion of a specified number of units is of 
limited importance to achievement* 

The road upon which the CESPschoolshave chosen to travel will continue 
to be a difficult one. It is of paramount importance that the schools and 
all V/ho are concerned with the success of CESP continue to be sel f-eval uati ve 
and indeed increase efforts in this area. The evaluation jJata that have been 
presented, only begin to probe the program areas and determine program 
strengths and weakness. CESP outcomes will be realized only to the degree 
that those of us concerned with CESP success are self-evaluative and use 
evaluation findings as tools to facilitate optimal program development. 
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